Social Distance and Face Mask Detection using vision-based sensors and IP cameras

Healthcare systems all over the world are strained as the COVID-19 pandemic's spread becomes more widespread. The only realistic strategy to avoid asymptomatic transmission is to monitor social distance, as there are no viable medical therapies or vaccinations for it. A unique computer vision-based framework that uses deep learning is to analyze the images that are needed to measure social distance. This technique uses the key point regressor to identify the important feature points utilizing the Visual Geometry Group (VGG19) which is a standard Convolutional Neural Network (CNN) architecture having multiple layers, MobileNetV2 which is a computer vision network that advances the-state-of-art for mobile visual identification, including semantic segmentation, classification and object identification. VGG19 and MobileNetV2 were trained on the Kaggle dataset. The border boxes for the item may be seen as well as the crowd is sizeable, and red identified faces are then analyzed by MobileNetV2 to detect whether the person is wearing a mask or not. The distance between the observed people has been calculated using the Euclidian distance. Pretrained models like (You only look once) YOLOV3 which is a real-time object detection system, RCNN, and Resnet50 are used in our embedded vision system environment to identify social distance on images. The framework YOLOV3 performs an overall accuracy of 95% using transfer learning technique runs in 22ms which is four times fast than other predefined models. In the proposed model we achieved an accuracy of 96.67% using VGG19 and 98.38% using MobileNetV2, this beats all other models in its ability to estimate social distance and face mask. © 2023 IEEE.

Smart Watch to Avoid Face Touching During Pandemic Condition

The most dangerous Coronavirus, COVID-19, is the source of this pandemic illness. This illness was initially identified in Wuhan, China, in December 2019, and currently sweeping the globe. The virus spreads quickly because it is so simple to transmit from one person to another. Fever is one of the obvious signs of COVID-19 and is one of its prevalent symptoms. The mucosal areas, such as the nose, eyes, and mouth, are among the most significant ways to catch this virus. In order to prevent and track the corona virus infection, this research suggests a face-touching detection and self-health report monitoring system. Their hygiene will immediately improve thanks to this system. In this pandemic circumstance, people use their hands in dirty environments like buses, trains, and other surfaces, where the virus can remain active for a very long time. With an accelerometer and a pulse oximeter sensor, this system alerts the user when they are carrying their hands close to their faces. © 2023 IEEE.

Face Recognition Attendance System

The conventional procedure used in all of India's major regions is attendance monitoring on paper with pens. Although the final data is computerized, it takes a long time to get from a classroom to a database. The effectiveness of the classes is directly impacted by the number of absences. The attendance takes up almost half of the lecture's allotted time. The alternative method that is being used involves using fingerprints, but even this approach is ineffective since it takes so long. Due to the illnesses (COVID-19) spreading over the world, however, the situation as it stands right now does not make this the best course of action. Therefore, it will be advisable to develop a contactless and more efficient. © 2023 IEEE.

Masked Face Recognition Model with Explainable AI

Due to the recent COVID-19 pandemic, people tend to wear masks indoors and outdoors. Therefore, systems with face recognition, such as FaceID, showed a tendency of decline in accuracy. Consequently, many studies and research were held to improve the accuracy of the recognition system between masked faces. Most of them targeted to enhance dataset and restrained the models to get reasonable accuracies. However, not much research was held to explain the reasons for the enhancement of the accuracy. Therefore, we focused on finding an explainable reason for the improvement of the model's accuracy. First, we could see that the accuracy has actually increased after training with a masked dataset by 12.86%. Then we applied Explainable AI (XAI) to see whether the model has really focused on the regions of interest. Our approach showed through the generated heatmaps that difference in the data of the training models make difference in range of focus. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

Masked Student Dataset of Expressions

Facial expression recognition (FER) algorithms work well in constrained environments with little or no occlusion of the face. However, real-world face occlusion is prevalent, most notably with the need to use a face mask in the current Covid-19 scenario. While there are works on the problem of occlusion in FER, little has been done before on the particular face mask scenario. Moreover, the few works in this area largely use synthetically created masked FER datasets. Motivated by these challenges posed by the pandemic to FER, we present a novel dataset, the Masked Student Dataset of Expressions or MSD-E, consisting of 1,960 real-world non-masked and masked facial expression images collected from 142 individuals. Along with the issue of obfuscated facial features, we illustrate how other subtler issues in masked FER are represented in our dataset. We then provide baseline results using ResNet-18, finding that its performance dips in the non-masked case when trained for FER in the presence of masks. To tackle this, we test two training paradigms: contrastive learning and knowledge distillation, and find that they increase the model's performance in the masked scenario while maintaining its non-masked performance. We further visualise our results using t-SNE plots and Grad-CAM, demonstrating that these paradigms capitalise on the limited features available in the masked scenario. Finally, we benchmark SOTA methods on MSD-E. The dataset is available at https://github.com/SridharSola/MSD-E. © 2022 ACM.

An Exploratory Study of Masked Face Recognition with Machine Learning Algorithms

Automated face recognition is a widely adopted machine learning technology for contactless identification of people in various processes such as automated border control, secure login to electronic devices, community surveillance, tracking school attendance, workplace clock in and clock out. Using face masks have become crucial in our daily life with the recent world-wide COVID-19 pandemic. The use of face masks causes the performance of conventional face recognition technologies to degrade considerably. The effect of mask-wearing in face recognition is yet an understudied issue. In this paper, we address this issue by evaluating the performance of a number of face recognition models which are tested by identifying masked and unmasked face images. We use six conventional machine learning algorithms, which are SVC, KNN, LDA, DT, LR and NB, to find out the ones which perform best, besides the ones which poorly perform, in the presence of masked face images. Local Binary Pattern (LBP) is utilized as the feature extraction operator. We generated and used synthesized masked face images. We prepared unmasked, masked, and half-masked training datasets and evaluated the face recognition performance against both masked and unmasked images to present a broad view of this crucial problem. We believe that our study is unique in elaborating the mask-aware facial recognition with almost all possible scenarios including half_masked-to-masked and half_masked-to-unmasked besides evaluating a larger number of conventional machine learning algorithms compared the other studies in the literature. © 2023 IEEE.

Face Mask detection using Mask R-CNN to control the spread of Covid-19

Business executives are developing cutting-edge digital solutions as the virus outbreak spreads. A face mask detection system is one of them, and it can be used to spot people wearing them. Face mask identification software and applications have already been released by a few businesses, and others have promised to do the same for the service. The proposed work examines face mask detection accuracy using CNN networks. Mask wear is now required in many developed and developing countries worldwide when leaving the house or entering public spaces. It will be difficult to maintain touchless access control in buildings while recognising faces wearing masks on any surveillance systems. Masks covering faces has made face detection algorithms and performance difficult. The proposed work detect face mask labeled no mask or mask with detection accuracy. The work train the system to click images of a face and provide labeled data. The work is classified using Convolution Neural Network (CNN), a Deep learning technique, to classify the input image with the help of the classification algorithm MobileNetV2. The trained system shows whether a person in the video frame is wearing a mask or not. © 2023 IEEE.

Masked Face Recognition System using Extended VGG-19

The scientific community has observed several issues as a result of COVID-19, both directly and indirectly. The use of face mask for health protection is crucial in the current COVID-19 scenario. Besides, ensuring the security of all people, from individuals to the state system, financial resources, diverse establishments, government, and non-government entities, is an essential component of contemporary life. Face recognition system is one of the most widely used security technology in modern life. In the presence of face masks, the performance of the current face recognition systems is not satisfactory. In this paper, we investigate a flexible solution that could be employed to recognize masked faces effectively. To do this, we develop a unique dataset to recognize the masked face, consisting of a frontal and lateral face with a mask. We propose an extended VGG19 deep model to improve the accuracy of the masked face recognition system. Then, we compare the accuracy of the proposed framework to that of well-known deep learning techniques, such as the standard Convolutional Neural Network (CNN) and the original VGG19. The experimental results demonstrate that the proposed extended VGG19 outperforms the investigated approaches. Quantitatively, the proposed model recognizes the frontal face with the mask with high accuracy of 96%. © 2022 IEEE.

FaST-Net: Face Style Self-Transfer Network for Masked Face Inpainting

During the COVID-19 coronavirus epidemic, people usually wear masks to prevent the spread of the virus, which has become a major obstacle when we use face-based computer vision techniques such as face recognition and face detection. So masked face inpainting technique is desired. Actually, the distribution of face features is strongly correlated with each other, but existing inpainting methods typically ignore the relationship between face feature distributions. To address this issue, in this paper, we first show that the face image inpainting task can be seen as a distribution alignment between face features in damaged and valid regions, and style transfer is a distribution alignment process. Based on this theory, we propose a novel face inpainting model considering the probability distribution between face features, namely Face Style Self-Transfer Network (FaST-Net). Through the proposed style self-transfer mechanism, FaST-Net can align the style distribution of features in the inpainting region with the style distribution of features in the valid region of a face. Ablation studies have validated the effectiveness of FaST-Net, and experimental results on two popular human face datasets (CelebA and VGGFace) exhibit its superior performance compared with existing state-of-the-art methods. © 2023 SPIE.

An approach for Face Detection and Face Recognition using OpenCV and Face Recognition Libraries in Python

With the extraordinary growth in images and video data sets, there is a mind-boggling want for programmed understanding and evaluation of data with the assistance of smart frameworks, since physically it is a long way off. Individuals, unlike robots, have a limited capacity to distinguish unexpected expressions. As a result, the programmed face proximity frame- work is important in face identification, appearance recognition, head-present evaluation, human-PC cooperation, and other applications. Software that uses facial recognition for face detection and identification is regarded as biometric. This study converts the mathematical aspects of a person's face into a face print, which is then stored in a database to verify an individual's identification. A deep learning system compares a digital image or an image taken quickly to a previously stored image(which is saved in the database). The face has a significant function in interpersonal communication for identifying oneself. Face recognition technology determines the size and placement of a human face in a digital picture. Facial recognition software has a wide range of uses in the consumer market and in the security and surveillance sectors. The COVID pandemic has brought facial recognition into greater focus lately than ever before. Face detection and recognition play a vital part in security systems that people need to interact with without making physical contact. The pattern of online exam proctoring is employing face detection and recognition. Facial recognition is used in the airline sector to enable rapid, accurate identification and verification at every stage of the passenger trip. In this research, we focused on image quality because it is the major drawback in existing algorithms and used OPEN CV, Face Recognition, and designed algorithms using libraries in python. This study discusses a method for facial recognition along with its implementation and applications. © 2023 IEEE.

Performance Evaluation of State-of-The-Art 2D Face Recognition Algorithms on Real and Synthetic Masked Face Datasets

Face recognition systems based on Convolutional neural networks have recorded unprecedented performance for multiple benchmark face datasets. Due to the Covid-19 outbreak, people are now compelled to wear face masks to reduce the virus's transmissibility. Recent research shows that when given the masked face recognition scenario, which imposes up to 70% occlusion of the face area, the performance of the FR algorithms degrades by a significant margin. This paper presents an experimental evaluation of a subset of the MFD-Kaggle and Masked-LFW (MLFW) datasets to explore the effects of face mask occlusion against implementing seven state-of-the-art FR models. Experiments on MFD-Kaggle show that the accuracy of the best-performing model, VGGFace degraded by almost 40%, from 82.1% (unmasked) to 40.4% (masked). On a larger-scale dataset MLFW, the impact of mask-wearing on FR models was also up to 50%. We trained and evaluated a proposed Mask Face Recognition (MFR) model whose performance is much better than the SOTA algorithms. The SOTA algorithms studied are unusable in the presence of face masks, and MFR performance is slightly degraded without face masks. This show that more robust FR models are required for real masked face applications while having a large-scale masked face dataset. © 2023, Penerbit Akademia Baru. All rights reserved.

Study on the Online Learning Evaluation Based on 2D and 3D Image Processing Technology

In recent years, the outbreak of the COVID-19 epidemic has posed a serious threat to the life safety of people around the world, which has also led to the development of a series of online learning assessment technologies. Through the research and development of a variety of online learning platforms such as WeChat, Tencent Classroom and Netease Cloud Classroom, schools can carry out online learning assessment, which also promotes the rapid development of online learning technology. Through 2D and 3D recognition technology, the online learning platform can recognize face and pose changes. Based on 2D and 3D image processing technology, we can evaluate students' online learning, which will identify students' learning state and emotion. Through the granulation of teaching evaluation, online learning platform can accurately evaluate and analyze the teaching process, which can realize real-time teaching evaluation of students' learning status, including no one, many people, distraction and fatigue. Through relevant algorithms, the online learning platform can realize the assessment of students' head posture, which will give real-time warning of learning fatigue. Firstly, this paper analyzes the framework of online learning quality assessment. Then, this paper analyzes the face recognition and head pose recognition technology. Finally, some suggestions are put forward. © 2023 SPIE.

Detection of Real Time Face Mask using Convolutional Neural Network

In recent years, the global pandemic like COVID - 19 has changed the lifestyle of people. Wearing face mask is must in order to stay safe and healthy. This paper presents a real-time face mask detector which identifies whether a human is wearing a mask or not. Moreover, this system can also recognize the person wearing a face mask inappropriately or wear other things except a face mask. The proposed algorithm for face mask detection in this system utilizes Haar cascade classifier to detect the face and Convolutional Neural Networks to detect the mask. The whole system has been demonstrated in a practical application for checking people wearing face mask. © 2023 IEEE.

Security Vulnerability in Face Mask Monitoring System

The COVID-19 pandemic has increased demand for face mask detection systems that utilize deep learning and machine learning algorithms. However, these systems are susceptible to adversarial attacks, where an attacker can manipulate the system to make incorrect predictions. This study aimed to test the vulnerability of a deep learning-based face mask detection model to a specific type of attack called a black box adversarial attack in which the attacker possesses only partial information about the target model. The study's findings showed that the attack successfully reduced the model's accuracy from 96.48% to 49.25%. This emphasizes the need for more robust defense mechanisms in face mask detection systems to ensure their reliability. © 2023 Bharati Vidyapeeth, New Delhi.

Computerized Face Mask Detection System Using Deep CNN and Transfer Learning

Since the COVID-19 pandemic is on the rise again with hazardous effects in China, it has become very crucial for global individuals and the authorities to avoid spreading of the virus. This research aims to identify algorithms with high accuracy and moderate computing complexity at the same time (although conventional machine learning works on low computation power, we have rather used CNN for our research work as the accuracy of CNN is drastically greater than the former), to identify the proper enforcement of face masks. In order to find the best Neural Network architecture we used many deep CNN Methodologies to solve classification problem in regards of masked and non masked image dataset. In this approach we applied different model architectures, like VGG16, Resnet50, Resnet101 and VGG19, on a large dataset to train on and compared the model on the basis of accuracy in which VGG16 came out to be the best. VGG16 was further tuned with different optimizers to determine the one best fit of the model. VGG16 gave an ideal accuracy of 99.37% with the best fit optimizer over a real life data set. © 2023 IEEE.

Masked Face Recognition Using Multi-Task Cascaded Convolutional Networks and FaceNet

Face masks have been widely used since the start of the COVID-19 pandemic. Facial detection and recognition technologies, such as the iPhone's Face ID, heavily rely on seeing the facial features that are now obscured due to wearing a face mask. Currently, the only way to utilize Face ID with a mask on is by having an Apple Watch as well. As such, this paper intends to find initial means of a reliable personal facial recognition system while the user is wearing a face mask without having the need for an Apple Watch. This may also be applicable to other security systems or measures. Through the use of Multi-Task Cascaded Convolutional Networks or MTCNN, a type of neural network which identifies faces and facial landmarks, and FaceNet, a deep neural network utilized for deriving features from a picture of a face, the masked face of the user could be identified and more importantly be recognized. Utilizing MTCNN, detecting the masked faces and automatically cropping them from the raw images are done. The learning phase then takes place wherein the exposed facial features are given emphasis while the masks themselves are excluded as a factor in recognition. Data in the form of images are acquired from taking multiple pictures of a certain individual's face as well as from repositories online for other people's faces. Images used are taken in various settings or modes such as different lighting levels, facial angles, head angles, colors and designs of face masks, and the presence or absence of glasses. The goal is to recognize whether it is the certain individual or not in the image. The training accuracy is 99.966% while the test accuracy is 99.921%. © 2022 IEEE.

Automated Contactless Continuous Temperature Monitoring System for Pandemic Disease Controlling Infrastructures

People are being thermally screened in hospitals and in such facilities, all the data collected must be stored and displayed. The person responsible for keeping track of people's body temperatures must put in more time and effort. This approach is a tedious task, especially during times of dealing with the pandemic diseases like Covid-19. Hence, in this paper, an automated contactless continuous temperature monitoring system is designed to eliminate this time-consuming process. If a person's temperature is too high, that is, higher than the usual temperature range, the system records it and monitors it continuously via a mobile application. In this paper, we present the development of an Automated contactless continuous body temperature monitoring system using a Raspberry Pi camera and mobile application. © 2023 IEEE.

YOLOv7 for Face Mask Identification Based on Deep Learning

The World Health Organization (WHO) has publicized a global public health emergency due to the COVID-19 coronavirus pandemic. Wearing a mask in public can provide protection against the spread of disease. Tremendous progress has been made in object detection in recent times, thanks in large part to deep learning models, which have shown encouraging results when it comes to recognizing objects in images. Recent technological developments have made this progress possible. Wearing a mask in public is one way to prevent the transmission of COVID-19 from others. Our study employs You Only Look Once (YOLO) v7 to determine whether a subject is wearing a mask, and then divides them into three groups depending on the degree to which they are wearing a mask correctly (none, bad, and good). In this study, we merged two datasets, the Face Mask Dataset (FMD) and the Medical Mask Dataset (MMD), to conduct our experiment. These models' evaluations and ratings include crucial criteria. According to our data, YOLOv7 achieves the highest mAP (98.5%) in the "Good"class. © 2023 IEEE.

An Automatic CNN-based Face Mask Detection Algorithm Tested During the COVID-19 Pandemics

The ongoing COVID-19 pandemic has highlighted the importance of wearing face masks as a preventive measure to reduce the spread of the virus. In medical settings, such as hospitals and clinics, healthcare professionals and patients are required to wear surgical masks for infection control. However, the use of masks can hinder facial recognition technology, which is commonly used for identity verification and security purposes. In this paper, we propose a convolutional neural network (CNN) based approach to detect faces covered by surgical masks in medical settings. We evaluated the proposed CNN model on a test set comprising of masked and unmasked faces. The results showed that our model achieved an accuracy of over 96% in detecting masked faces. Furthermore, our model demonstrated robustness to different mask types and fit variations commonly encountered in medical settings. Our approaches reaches state of the art results in terms of accuracy and generalization. © 2022 Copyright for this paper by its authors.

Longitudinal Analysis of Mask and No-Mask on Child Face Recognition

Face is one of the most widely employed traits for person recognition, even in many large-scale applications. Despite technological advancements in face recognition systems, they still face obstacles caused by pose, expression, occlusion, and aging variations. Owing to the COVID-19 pandemic, contactless identity verification has become exceedingly vital. To constrain the pandemic, people have started using face mask. Recently, few studies have been conducted on the effect of face mask on adult face recognition systems. However, the impact of aging with face mask on child subject recognition has not been adequately explored. Thus, the main objective of this study is analyzing the child longitudinal impact together with face mask and other covariates on face recognition systems. Specifically, we performed a comparative investigation of three top performing publicly available face matchers and a post-COVID-19 commercial-off-The-shelf (COTS) system under child cross-Age verification and identification settings using our generated synthetic mask and no-mask samples. Furthermore, we investigated the longitudinal consequence of eyeglasses with mask and no-mask. The study exploited no-mask longitudinal child face dataset (i.e., extended Indian Child Longitudinal Face Dataset) that contains 26,258 face images of 7,473 subjects in the age group of [2, 18] over an average time span of 3.35 years. Due to the combined effects of face mask and face aging, the FaceNet, PFE, ArcFace, and COTS face verification system accuracies decrease by approximately , , , and , respectively. © 2022 ACM.